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OPERANT  CONDITIONING  OF  VASOCONSTRICTION 


Since  Skinner's  (1938)  mention  of  an  unsuccessful  attempt  to  ob- 
tain operant  conditioning  of  vasoconstriction,  several  reports  of  oper- 
ant conditioning  of  autonomic  activity  have  appeared.    Razran  (I96I) 
reported  an  experiment  by  Lisina  (1958)  in  which  vasoconstriction  was 
transfonned  into  vasodilation  when  subjects  could  watch  their  record 
and  note  the  connection  between  vasodilatation  and  shock  termination. 
Cognitive  mediation  was  also  employed  by  Shearn  (I962)  in  operant  con- 
ditioning of  heart  rate;  heart  beats  were  audible  to  the  subject  over  a 
loudspeaker.    When  such  direct  mediation  has  not  been  provided,  operant 
conditioning  has  been  observed  by  Fowler  and  Kimmel  (I962)  with  the 
galvanic  skin  response  (GSR).    However,  their  curves  did  not  show  an 
increase  in  GSR  frequency  resulting  from  the  operant  procedure;  instead, 
performance  remained  relatively  constant  in  the  experimental  group 
while  it  decreased  in  the  control  group.    Presumably,  adaptation  oc- 
curred in  both  groups.    In  a  later  study,  Kimmel  and  Kimmel  (I963)  ob- 
tained an  initial  brief  rise  during  conditioning  but  again  followed  by 
adaptation.    However,  Crider,  Shapiro,  and  Tursky  (I966)  found  long- 
term  incremental  GSR  operant  conditioning  in  an  experimental  group  that 
had  an  initially  low  operant  level.    Apparently,  a  control  on  general 
activation  level  is  necessary  (as  in  the  latter  experiment)  to  isolate 
specific  from  nonspecific  adaptation  effects. 

In  another  species,  Fromer  (I963)  reported  a  series  of  three  ex- 
periments with  volume  changes  in  the  ear  of  rabbits,  comparing  discrim- 
inant operant  conditioning  with  classical  conditioning,  using  negative 
reinforcement  (electric  shock).    Performance  improved  under  all  condi- 
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tions,  but  there  was  greater  resistance  to  extinction  in  the  discrim- 
inant operant  than  with  classical  conditioning. 

Historically,  the  theoretical  significance  of  autonomic  condition- 
ing, and  vasomotor  in  particular,  may  be  traced  back  to  Lange's  (188$) 
theory  of  emotion.    Lindsley  (1951)  states: 

Lange's  theory,  put  forth  independently,  held  that  a  stimulus 
object  or  situation  gives  rise  immediately  to  vasomotor  changes 
wherever  blood  vessels  are  found.    The  secondary  changes  occurring 
in  the  tissues  were  believed  to  give  rise  to  the  sensations  that 
constitute  the  emotion.    More  recent  interpretations  of  Lange's 
theory  have  recognized  that  the  sensory  impulses  may  arise  from 
receptors  in  the  blood  vessels  themselves  (p.  $01) » 

There  have  been  some  impressive  demonstrations  of  vasomotor  con- 
ditioning and  "voluntary"  control  (Kennard,  1937 J  Lisina,  1958).  All 
lack  some  of  the  necessary  controls  (Shmavonian,  1959),  but  apparently 
vasomotor  classical  conditioning  and  control  (by  the  subject's  own  ver- 
bal mediation,  established  by  classical  conditioning)  is  possible. 
Berlyne  (i960)  stresses  the  significance  of  orienting  responses 
(Sokolov,  1963)  which  are  probably  involved  here. 

But  classical  conditioning  procedures  do  not  appear  to  be  provid- 
ing the  answer  to  the  problem  of  how  vasomotor  activity  normally  af- 
fects behavior.    Lacey  (1958)  has  stated  that  "...feedback  via  visceral 
afferents  and  reticular  formations,  or  via  the  baroreceptors ,  implies 
that  an  autonomic  response  becomes  a  stimulus"  (p.  202).    But  a  series 
of  experiments  on  autonomic  feedback  in  perceptual  learning  (Snyder, 
i960),  based  on  two-factor  learning  theory,  gave  inconclusive  results. 
The  most  likely  difficulty  was  that  "...in  general  the  very  long  reac- 
tion times  of  autonomic  responses  make  it  difficult  to  use  sensory  sig- 
nals, which  feed  back  from  these  responses,  as  CSs  which  serve  as  cues 


for  perceptual  acts"  (Solley  and  Murphy,  I960,  p.  251) • 

Skinner's  dictum  -  that  "There  is  little  reason  to  expect  operant 
conditioning  of  autonomic  activity  since  it  does  not  as  a  rule  natural- 
ly act  upon  the  environment  in  any  way  that  will  produce  a  reinforce- 
ment..." (1938,  p.  112)  -  seems  to  apply  very  well  in  the  case  of  GSR. 
But  the  general  hypothesis  being  considered  here  is  that  vasomotor 
operant  conditioning  could  very  well  be  involved  in  the  contact  with 
the  environment,  i.e.,  that  certain  patterns  of  autonomic  activity  may 
be  negatively  or  positively  reinforced  by  stimulus  objects  in  the  en- 
vironment via  the  autonomic  effect  upon  selective  attention. 

Within  this  framework  of  the  general  problem,  two  experiments  were 
performed  to  investigate  the  operant  conditioning  of  finger  vasocon- 
strictions in  human  subjects,  with  controls  for  possible  mediation  by 
skeletal  musculature  including  body  movements  and  respiration. 

In  the  first  experiment,  reinforcement  was  given  in  the  context  of 
a  pseudo-task  of  discriminating  small  temperature  changes  in  the  finger 
The  purpose  of  the  pseudo-task  was  to  provide  a  reason  for  the  brief 
light  signal  that  served  as  reinforcement  and  to  focus  the  subject's 
attention  on  the  finger  but  away  from  the  response  being  conditioned. 
There  were  controls  for  possible  mediation  of  vasoconstriction  by  the 
signal  light,  by  the  thermal  stimuli,  and  by  verbal  reports  of  temper- 
ature discriminations. 

In  the  second  experiment,  the  control  problem  was  simplified  by 
eliminating  the  thermal  stimuli  and  verbal  reports,  and  direct  controls 
were  taken  on  skeletal  muscle  tension  and  respiration  by  separate  osciL 
lographic  recording.    An  extinction  procedure  was  also  added,  with  ex- 
perimental subjects  divided  into  two  extinction  conditions. 


Experiment  I 


Method 

Subjects.    A  total  of  2h  students  from  introductory  psychology 
classes  were  used,  5  males  and  7  females  in  each  of  two  groups.  Sub- 
jects received  course  credit  for  participation.    Three  additional  sub- 
jects were  excluded  from  the  results:  one  because  of  insufficient  time, 
one  because  of  no  detectable  finger  volume  changes,  and  one  because  a 
finger  tic  produced  very  large  movement  artifacts. 

Apparatus .    Finger  volume  changes  were  recorded  with  a  Yellow 
Springs-Fels  plethysmograph  on  one  channel  of  a  Sanborn  Model  320  Dual 
Channel  DC  Amplifier-Recorder  at  1  mm. /sec.  speed.    Preliminary  tests 
indicated  that  thermostatic  control  of  finger  temperature  was  unneces- 
sary for  the  present  purposes:  changes  of  3°  C.  produced  only  a  slow 
change  of  1  mm,  in  the  record,  too  small  and  slow  to  be  confused  with 
vasoconstrictions.    Instead,  the  Yellow  Springs  Model  73  Tele-Thermom- 
eter was  used  for  temperature  stimulation  and  recording  (on  the  other 
Sanborn  channel)  with  the  subject's  right  index  finger  tip  resting 
lightly  on  the  temperature  probe  tip  in  the  plethysmograph  water  cup. 

The  subject  was  located  in  a  separate  sound-treated  room,  seated 
in  a  dental  chair  in  front  of  a  table  containing  a  large  white  viewing 
box  in  the  shape  of  a  hemicylinder .    The  right  arm  was  on  an  arm  rest 
with  the  index  finger  in  the  plethysmograph  cup.    The  finger  was  approxi' 
mately  at  heart  level  and  at  the  water  line  of  the  plethysmograph  stand- 
pipe.    The  reinforcement  light  was  an  NE-51  neon  lamp  in  a  standard 
neon  light  assembly  with  frosted  white  plastic  dome  located  in  the  cen- 
ter of  the  screen  at  eye  level.    The  neon  lamp  was  operated  at  0.1  watt 


for  1-sec.  duration  from  a  Tektronix  Model  162  Waveform  Generator  and 
an  external  UO-V.  fixed  supply,  and  recorded  on  one  Sanborn  marker  chan- 
nel.   At  the  2-ft.  viewing  distance  the  signal  light  illuminance  meas- 
ured 0.001  ft. -candle  on  a  Photovolt  Model  $01-M  Electronic  Photometer 
(with  a  Type  B  phototube).    Room  illumination  consisted  of  a  25-watt 
ceiling  lamp  and  20-watt  fluorescent  lamp  in  the  viewing  box. 

The  experimenter  and  most  of  the  equipment  were  located  in  an  ad- 
joining room.    Verbal  reports  of  temperature  discriminations  were  heard 
over  an  intercom  and  recorded  on  a  second  Sanborn  marker  channel  by  the 
experimenter. 

Procedure .    After  the  subject  was  seated  and  the  apparatus  adjust- 
ed, the  following  instinictions  were  read: 

This  is  an  experiment  in  judging  very  small  temperature 
changes  in  the  finger  tip.    I  will  put  this  plastic  cup  on  your 
right  index  finger  and  it  will  be  filled  with  water.    In  this  de- 
vice there  are  means  of  slightly  warming  or  cooling  the  water  sur- 
rounding your  finger  and  also  a  pickup  to  record  the  temperature 
changes  on  a  recorder.    This  is  also  very  sensitive  to  finger 
movements,  so  during  the  experiment  try  not  to  move  this  finger 
any  more  than  absolutely  necessary  (show  record  of  movement  arti- 
fact).   Your  finger  should  be  resting  lightly  on  the  end  of  the 
plug  in  the  cup  at  all  times.    For  the  same  reason,  please  try  to 
relax  as  comfortably  as  possible  in  one  position  and  don't  make 
any  kind  of  movement  unnecessarily  during  the  experiment. 

In  this  experiment,  we  will  be  measuring  how  accurately  you 
can  detect  small  changes  in  finger  temperature .    Whenever  you  feel 
a  slight  increase  in  temperature,  report  "warmer"  -  I  can  hear  you 
over  this  intercom  -  and  whenever  you  feel  a  slight  decrease  in 
temperature,  say  "cooler."    During  the  first  five  minutes  we'll 
simply  determine  how  you  do  at  this  without  practice.    You  can 
probably  do  best  if  you  can  find  a  comfortable  posture,  relax  all 
your  muscles  as  completely  and  generally  as  possible,  breath 
quietly  and  evenly,  and  don't  use  any  more  energy  than  necessary 
in  giving  your  reports.    After  this  there  will  be  a  one-minute 
rest  when  you  will  be  free  to  move  around  without  upsetting  the 
recording.    Do  you  have  any  questions? 

A  five-minute  period  of  operant  vasomotor  activity  with  no  rein- 


forcement was  then  recorded.    During  this  time,  differential  tempera- 
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ture  discrimination  was  measured  by  the  Method  of  Limits.    Since  the 
temperature  stimulation  was  controlled  by  turning  on  or  off  the  ple- 
thysmograph  cup  heater,  the  average  starting  point  (36°  C.)  had  to  be 
above  normal  finger  skin  temperature  (about  32°  C).    Different  start- 
ing points  and  a  pseudo-random  order  of  stimulation  were  given. 

During  the  one-minute  rest  period  that  followed,  the  reinforcement 
criterion  of  vasoconstriction  -  SO  per  cent  of  average  baseline  ampli- 
tude -  was  estimated  from  inspection  of  the  plethysmograph  recording. 
Then  the  training  instructions  were  given: 

Now  we  want  to  see  how  much  you  can  improve  your  judgment  by 
training.    Continue  to  make  your  reports  of  "warmer"  and  "cooler," 
and  I  will  signal  you  when  you  are  correct  by  flashing  on  the  lit- 
tle light  in  front  of  you.    It's  also  important  that  you  do  not 
report  a  change  when  there  is  no  change  so  I  may  occasionally 
flash  the  light  on  to  signal  that  you  are  correct  by  not  reporting 
any  change  at  all.    (A  necessary  instruction  since  vasoconstriction 
reinforcements  would  seldom  follow  verbal  reports,  especially  in 
the  control  group.)    So  any  flash  of  the  light  means  that  you  are 
correct.    Try  to  report  even  the  slightest  change  and  don't  be 
afraid  to  guess  when  you  are  not  sure.    Remember  to  relax  as  much 
as  possible,  breath  quietly  and  evenly,  and  don't  use  any  more 
energy  than  necessary  in  giving  your  verbal  reports.    Do  you  have 
any  questions? 

Then  followed  a  30-minute  experimental  period,  with  subjects  in 
Group  E  receiving  100  per  cent  reinforcement  (light  signal  of  "correct") 
of  all  vasoconstrictions  reaching  50  per  cent  of  average  baseline  ampli- 
tude , 

Control  subjects,  matched  in  sex,  age,  instructions,  and  in  number 
of  reinforcements  in  each  minute,  differed  from  their  corresponding  ex- 
perimental subjects  only  in  being  given  the  light  signal  after  five 
seconds  of  essentially  zero  fluctuation  in  finger  volume. 

Scoring.    Oscillographic  records  were  scored  using  a  more  rigor- 
ous procedure  than  was  possible  during  training  in  determining  those 


responses  to  be  reinforced.    Now,  instead  of  merely  determining  whether 
or  not  the  amount  of  change  exceeded  50  per  cent  of  the  baseline  change, 
four  criteria  were  used.    First,  the  required  amplitude  was  determined 
for  each  subject  so  as  to  exclude  changes  that  could  be  attributed  to 
respiration  or  pulse  (see  Burch,  Cohn,  and  Neumann,  19U2,  for  illustra- 
tions of  these  changes).    In  all  instances,  the  amount  of  change  was 
greater  than  50  per  cent  of  the  mean  baseline  change,  and  in  most  in- 
stances was  closer  to  90  per  cent  of  the  mean  baseline  changed  Second, 
responses  were  restricted  to  those  in  which  the  peak  amplitude  of  vaso- 
constriction occurred  within  10  seconds  after  the  initial  deflection  of 
the  galvanometer,  in  order  to  include  characteristic  vasoconstrictions 
but  to  exclude  slow  drifts  in  the  vasomotor  waves.    Third,  all  movement 
artifacts  produced  by  rapid  movement  of  the  finger  or  body  (as  indi- 
cated by  abrupt  irregularities  in  the  plethysmograph  record)  were  ex- 
cluded.   And  fourth,  all  criterion  vasoconstrictions  that  began  0-6 
seconds  following  a  verbal  report  by  the  subject  of  a  change  in  temper- 
ature were  excluded,  even  though  these  had  been  reinforced  for  subjects 
in  Group  E.    Such  vasoconstrictions  amounted  to  about  UO  per  cent  of 
all  criterion  vasoconstrictions  during  the  30-minute  training  period 
for  both  groups  and  remained  evenly  distributed  across  all  periods. 
This  verbal  response  artifact  appeared  to  be  a  constant  factor  in  both 
groups  since  for  both  groups  combined  there  was  an  insignificant  change 
in  mean  number*  of  temperature  discriminations  from  7»0  in  the  first 


The  criterion  amplitude  ranged  from  1.20  to  2.10  cu.  mm.,  with  a 
mean  of  1.56  cu.  mm,  for  Group  E;  and  ranged  from  1.05  to  2.25  cu.  mm., 
with  a  mean  of  1.75  cu.  mm.  for  Group  C.    The  difference  between  means 
was  not  significant  (p>,05). 


five-minute  period  to  7.6  in  the  last  period. 

Each  response  that  was  scored  thus  was  a  vasoconstriction,  not  re- 
lated to  movement  or  verbal  response  artifact,  that  reached  peak  ampli- 
tude within  ten  seconds  after  it  was  initiated,  and  that  showed  gradu- 
ally decreasing  volume  together  with  gradually  decreasing  pulse  ampli- 
tude and  change  in  the  pulse  dicrotic  notch. 

Results 

Conditioned  vasoconstrictions.    The  mean  number  of  vasoconstric- 
tions that  met  the  criteria  specified  above  are  shown  in  Fig.  1.  Dur- 
ing the  baseline  period  the  difference  between  the  means  of  the  experi- 
mental and  control  conditions  was  negligible  (F  =  O.OO6).  Thereafter, 
however,  the  number  of  vasoconstrictions  rose  from  a  mean  of  2.0  to  a 
mean  of  8.2  by  the  end  of  training  for  the  experimental  condition.  For 
the  control  condition,  on  the  other  hand,  the  mean  performance  remained 
essentially  constant  throughout  training.    The  difference  between  con- 
trol and  experimental  condition  for  all  training  periods  combined  was 
statistically  significant  by  analysis  of  variance  (F  =  $7.18,  1  &  11  df , 
p  <.001).         ,  ■  - 

There  were  large  individual  differences  in  conditioning.    In  Group 
E,  individual  subjects  reached  peaks  in  frequency  of  criterion  vaso- 
constrictions ranging  from  6  to  Hi  per  five-minute  period,  correspond- 
ing to  rates  ranging  from  3  to  7  times  the  average  baseline  operant 
level.    Females  reached  a  mean  peak  of  5.5  times  their  initial  operant 
rate  after  20  minutes  of  training,  while  males  reached  a  mean  peak  of 
3.1  times  their  initial  operant  rate  after  25  minutes  of  training. 
However,  the  sex  difference  for  total  number  of  criterion  vasocon- 
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strictions  during  training  was  not  significant  (Mann-Whitney  U  =  13, 
p  >.50). 

Respiration  control.    Also  shown  in  Fig.  1  (Curve  R)  are  the  re- 
sults of  an  analysis  of  the  effects  of  respiration  upon  vasoconstric- 
tion.   Vasoconstriction  invariably  occurs  each  time  a  deep  inspiration 
is  taken  and  held  (Bolton,  Carmichael,  and  Sttlrup,  1936).    A  separate 
record  of  respiration  was  not  taken  in  this  experiment  but  small  res- 
piratory waves  appear  in  plethysmographic  records  of  finger  volume 
(Burch  et  al.,  19U2)  and  scoreable  waves  were  found  in  all  12  subjects 
of  Group  E,  except  when  possibly  obscured  during  large  vasoconstric- 
tions.   Analysis  of  these  waves  should  provide  a  satisfactory  control 
since  vasoconstriction  has  about  a  3-sec.  latency  and  any  respiratory 
irregularity  or  breath-holding  should  be  easily  detectable  in  the  res- 
piratory cycle  preceding  a  vasoconstriction. 

A  criterion  vasoconstriction  was  scored  as  a  possible  respiratory 
artifact  if  (1)  there  was  no  detectable  dip  at  the  expected  point  as- 
suming a  regular  respiratory  rhythm,  or  if  (2)  the  respiratory  period 
varied  more  than  1  sec.  either  for  the  immediately  preceding  cycle  or 
during  vasoconstriction.    It  was  not  possible  to  analyze  irregularities 
in  respiratory  amplitude  although  an  amplitude  change  is  usually  accom- 
panied by  a  rate  change  and  respiratory  periods  were  very  rarely  found 
to  vary  more  than  1  sec.  from  mean  period  for  the  entire  experiment. 
Possible  respiratory  artifacts  were  found  to  be  quite  rare  and  nearly 
all  due  to  the  first  criterion  listed  above  during  large  vasoconstric- 
tions when  respiratory  waves  might  be  obscured  by  the  superimposed  vas- 
omotor wave.    The  mean  number  of  these  possible  artifacts  are  plotted 
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in  Fig.  1,  where  it  can  be  seen  that  Curve  R  (for  Group  E  only)  begins 
at  0.25  and  rises  only  to  0.58  during  the  experiment.    No  cases  of 
breath-holding  were  found  and  there  were  no  missing  respiratory  cycles 
in  the  records  except  during  large  vasoconstrictions. 

Thermal  stimuli  control.    Since  peripheral  vasomotor  activity  is 
normally  involved  in  the  temperature  regulation  of  the  body,  it  was 
necessary  to  check  on  possible  initiation  of  vasoconstrictions  by  the 
thermal  stimuli  used  in  the  pseudo-task.    The  temperature  changes  were 
very  slow  (means  of  U.7°  C./min.  for  warming  and  1.8°  C./min.  for  cool- 
ing), very  small  (limited  to  DL  which  averaged  about  1-2°  C),  and  lim- 
ited to  one  finger  tip,  so  no  effect  was  expected.    In  Group  G  there 
was  a  mean  of  10  vasoconstrictions  during  warming  and  16  during  cooling 
over  the  35min.  of  the  experiment.    However,  this  difference  is  due 
entirely  to  the  fact  that,  in  the  loosely  controlled  pseudo-task,  there 
were  50  per  cent  more  cooling  trials  than  warming  trials . 

Activation  level  control.    Respiratory  rates  and  pulse  rates  were 
scored  from  the  plethysmograph  records  to  see  if  general  autonomic  ad- 
aptation during  training  might  have  contributed  to  the  conditioning  ef- 
fect in  Group  E.    Mean  respiratory  rate  decreased  slightly  from  16.3  to 
15.6  cycles/min.    Mean  pulse  rate  increased  slightly  from  8U.0  to  85.9 
beats/min.    However,  neither  of  these  changes  were  significant  (p>.05) 
by  the  Binomial  Sign  Test,  indicating  that  general  autonomic  levels  re- 
mained stable. 

Discussion 

The  main  results  are  clear-cutj  the  operant  procedure  resulted  in 
a  significant  increase  in  number  of  vasoconstrictions.    Moreover,  this 
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increase  does  not  appear  to  have  been  mediated  by  gross  skeletal  muscle 
activity.    The  analyses  appear  to  rule  out  both  respiration  and  gross 
movements  of  the  hand.    Since  the  hydroplethysmograph  is  quite  sensi- 
tive to  movement  artifacts,  any  movements  of  other  parts  of  the  body 
large  enough  to  produce  vasoconstriction  should  also  have  been  detected 
if  they  had  been  present. 

Inspection  of  the  results  also  suggests  that  the  temperature 
changes  included  in  the  pseudo-task  did  not  affect  the  results.    In  ad- 
dition, there  was  no  difference  in  this  regard  in  method  between  experi- 
mental and  control  conditions.  ' 

The  method  does  not  permit  verbal  mediation  to  be  entirely  i-uled 
out;  on  the  other  hand,  no  vasoconstrictions  that  followed  within  six 
seconds  the  subjects'  verbal  reports  were  scored.    Furthermore,  al- 
though some  verbal  responses  were  reinforced,  in  neither  condition  did 
the  frequency  of  such  verbal  responses  increase  as  training  progressed. 

r  -      Experiment  II        .     .  ■ .  ^.  •  . 

The  results  of  Experiment  I  were  inconclusive  for  several  reasons. 
The  type  of  criticism  that  Church  (196h)  has  made  of  yoked  experimental- 
control  designs  applies  to  the  present  design,  although  in  a  unique  way 
Church's  main  point  is  that  when  experimental  and  control  subjects  are 
paired  and  run  simultaneously,  and  the  experimental  subject  receives 
contingent  reinforcement  while  his  control  receives  the  same  reinforce- 
ment but  non-contingent  upon  his  responses,  and  these  latter  reinforce- 
ments produce  artifactual  responses  which  are  then  subsequently  ex- 
cluded from  the  analysis;  then,  a  bias  is  introduced  into  the  results 
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which  favors  conditioning  performance  of  the  experimental  group.  This 
is  because  reinforcements  are  given  to  experimental  subjects  just  after 
their  responses,  when  response  probability  is  lowest,  while  non-contin- 
gent reinforcements  are  given  control  subjects  when  their  response 
probability  is  much  higher. 

In  the  design  of  Experiment  I,  the  possibility  of  introducing  this 
kind  of  bias  was  even  magnified:  control  subjects  received  reinforce- 
ments contingent  upon  their  non-response  when  probability  of  responding 
would  obviously  be  at  its  highest  point.    Elimination  of  all  responses 
to  the  reinforcement  from  the  results  of  both  groups  would  then  exclude 
many  more  artifactual  responses  from  control  than  from  experimental 
data.    Fortunately  in  that  experiment,  the  reinforcement  conditions 
were  such  that  there  were  no  such  vasoconstrictions,  of  criterion  am- 
plitude to  the  signal  light,  that  had  to  be  excluded  from  the  results 
of  either  group.    In  fact,  for  the  control  subjects  there  were  more 
vasodilatations  (mean  of  28.8)  than  vasoconstrictions  (mean  of  11.1)  to 
the  light.    In  addition,  it  can  be  noted  in  Fig.  1  that  the  control 
curve  drops  slightly  (but  not  significantly),  rather  than  rises,  when 
the  reinforcement  was  introduced  following  the  baseline  condition  (in 
which  neither  group  received  reinforcement). 

However,  one  could  point  out  that  the  criterion  vasoconstrictions 
following  verbal  responses  were  excluded  from  the  results,  which  would 
then  be  biased  if  control  subjects  produced  an  increasing  number  or  a 
greater  number  of  these  overall  than  experimental  subjects.  However, 
the  data  were  in  just  the  opposite  direction;  in  Group  C,  the  total 
number  of  excluded  responses  began  at  17  and  decreased  slightly  to  lU 
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at  the  end  of  training,  while  in  Group  E,  the  total  number  of  excluded 
responses  began  at  16  and  increased  to  36  by  the  end  of  training.  Con- 
sequently, omitting  these  artifacts  could  have  led  only  to  a  bias  a- 
gainst  group  differences,  on  the  basis  of  Church's  argument. 

The  control  measures  on  respiration  and  skeletal  muscle  activity 
were  gross,  depending  on  artif actual  components  of  the  plethysmogram. 
However,  in  this  connection,  it  can  be  noted  that  the  vasoconstriction 
criterion  was  comparably  gross:  the  amplitude  of  response  had  to  be  a- 
bout  90  per  cent,  on  the  average,  of  constrictions  in  the  baseline  per- 
iod to  count.    Thus,  the  method  missed  both  small  respiratory  irregu- 
larities and  also  their  resulting  vasoconstriction  reflexes. 

In  regard  to  other  subtle  skeletal  muscle  activity,  on  the  other 
hand,  the  interpretation  is  on  unsafe  ground.    A  study  by  Neumann, 
Lhamon,  and  Cohn  (I9UI4)  suggests  that  skeletal  muscle  tension  may  be 
inversely  related  to  vasomotor  tone  (as  indicated  by  pulse  volume  am- 
plitude) in  the  extremities.    This  means  in  the  present  procedure  that 
the  frequency  of  large  vasoconstrictions  could  increase  merely  because 
of  increasing  relaxation  of  subjects  during  the  training.    The  slightly 
increasing  mean  heart  rate  found  for  Group  E  suggests  otherwise,  but 
only  a  direct  measure  of  skeletal  muscle  tension  by  electromyographic 
(EMG)  recording  could  verify  this  assumption. 

In  addition  to  these  refinements,  it  also  was  desirable  to  elimi- 
nate the  subjects'  pseudo-task  so  as  to  do  away  with  thermal  stimula- 
tion of  the  finger  and  with  verbal  reports  along  with  their  associated 
vasoconstrictions.    This  required  a  marked  alteration  of  the  instruc- 
tions to  enlist  the  subject's  cooperation  in  attending  to  the  signal 
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light  and  in  controlling  his  movements,  muscular  tension,  and  breathing 
irregularities. 

Finally,  it  was  desirable  to  include  an  extinction  procedure,  to 
determine  if  the  difference  between  the  experimental  and  control  con- 
ditions remained  when  reinforcement  was  omitted. 

Method 

Design.    The  basic  design  involved  five  independent  groups  of  sub- 
jects: two  experimental  groups,  two  control  groups,  and  one  baseline 
control  group.    For  certain  statistical  analyses,  sex  was  included  as 
an  additional  variable. 

The  two  experimental  groups  (EC  and  EN)  were  treated  alike  during 
acquisition,  with  each  vasoconstriction  followed  by  reinforcement. 
During  extinction,  reinforcement  was  omitted  entirely  for  Group  EW,' 
while  for  Group  EC  a  counter-conditioning  procedure  was  employed,  with 
reinforcement  contingent  upon  failure  to  exhibit  vasoconstriction. 

The  two  control  conditions  were  matched  to  Groups  EC  and  EN  as  in 
Experiment  I,  and  were  treated  identically  during  both  the  acquisition 
and  the  extinction  phases.    During  the  acquisition  phase,  reinforcement 
was  contingent  upon  failure  to  exhibit  vasoconstrictions j  during  the 
extinction  phase  reinforcement  was  entirely  omitted. 

The  baseline  control  group  (B)  received  no  reinforcement  at  any 

time. 

Subjects.    A  total  of  $U  students  from  introductory  psychology 
classes  were  used,  6  males  and  6  females  in  each  of  the  two  experimen- 
tal and  the  two  control  groups,  and  3  males  and  3  females  in  the  final 
group  (B).    The  data  of  7  subjects  (3  males,  k  females)  were  excluded 
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and  replaced  either  because  of  an  equipment  failure  (n=2)  or  because  of 
excessive  movement  (n=5).  ' 

Experimental  subjects  were  assigned  to  extinction  condition  ac- 
cording to  a  predetermined  random  order.    A  matched  control  subject  was  • 
run  as  soon  as  the  number  of  reinforcements  per  period  for  each  experi- 
mental subject  had  been  determined. 

Apparatus .    Right  index  finger  volume  was  recorded  from  a  Yellow  ;^ 
Springs-Fels  plethysmograph  on  one  channel  of  a  Beckman-Offner  Model  R 
Dynagraph  oscillographic  recorder  at  2,$  mm. /sec.  speed  with  a  Type 
9806A  AC /DC  Input  Coupler  (set  for  DC).    The  electronically  controlled 
heater  of  the  finger  cup  was  modified  to  DC  operation  to  eliminate  60- 
cycle  interference  to  EMG  recording,  and  cup  water  temperature  was  held 
to  within  0.5°  of  35°  C. 

Right  forearm  extensor-flexor  EMG  was  recorded  on  a  second  oscillo- 
graph channel  using  a  Type  9852  EMG  Integrator  Input  Coupler  modified 
to  0.25  sec.  rise  and  1.0  sec.  decay  time  constants.    The  EMG  electrodes 
were  two  standard  EKG  arm  electrodes  (32  x  55  mm.)  plus  a  third  similar  ' 
electrode  for  ground  (placed  on  the  forearm  near  the  elbow).  Sanborn 
Redux  paste  was  applied  to  the  electrodes,  which  were  held  in  place 
lightly  with  standard  arm  straps.    Preliminary  tests  indicated  that 
placement  of  the  two  active  electrodes  for  maximal  EMG  from  isometric 
extension  and  flexion  of  the  index  finger  also  gave  a  measureable  indi- 
cation of  any  movement  or  muscle  tension  great  enough  to  produce  a  fin- 
ger vasoconstriction  or  to  affect  vasomotor  tone  (as  indicated  by  finger 
pulse  volume  amplitude).    The  oscillographic  recorder  at  maximum  sensi- 
tivity had  a  sine-wave  frequency  response  of  50  to  1700  cy./sec.  (at 
505C  down)  and  a  nonlinear  calibration  from  1  to  50  microvolts  peak-to- 
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peak,  in  terms  of  equivalent  sine-wave  input  at  $00  cy./sec. 

Abdominal  and  thoracic  respiration  were  recorded  on  the  third  and 
fourth  oscillograph  channels  with  Type  9806A  AC/DC  Input  Couplers  (set 
for  DC)  from  mercury-in-rubber  strain  gages  around  the  trunk  at  the 
xiphoid  and  under-arm  levels.    Each  gage  operated  in  a  full  bridge  re- 
sistance circuit  powered  by  a  mercury  cell.    The  gages  were  made  up  ac- 
cording to  Ackner's  (1956)  description  except  for  the  use  of  pure  sil- 
ver electrodes  which  are  much  more  stable  with  mercury  than  stainless 
steel  electrodes. 

The  reinforcement  light  was  a  standard  pilot  light  assembly  with 
translucent  plastic  dome  and  incandescent  lamp  (#U9)  operated  at  0.1 
watt  (DC).    This  light  was  turned  on  by  the  experimenter's  manual 
switch,  recorded  on  the  marker  channel  of  the  oscillograph,  and  turned 
off  after  3  sec.  by  a  Hunter  timer.    The  light  was  located  on  a  small 
sloping  panel  (9  x  13")  on  the  front  of  the  subject's  desk  chair,  which" 
also  served  as  a  rest  for  the  right  am  and  plethysmograph  cup. 

The  15  X  20'  subject's  room  was  normally  lighted,  sound- treated 
(for  60  Db,  attenuation  of  external  noise),  and  electrostatically 
shielded  by  grounded  copper  screening  in  the  walls,  ceiling,  and  floori 
The  only  equipment  located  in  this  room  was  the  plethysmograph  hydrau- 
lic unit,  an  intercom,  and  a  loudspeaker  for  about  60  Db.  sound  level 
of  white  masking  noise.    There  was  no  electrical  interference  to  EM3 
from  any  inside  or  outside  source  except  from  the  remote-controlled 
motor  that  adjusted  the  water  level  in  the  plethysmograph  standpipe  and 
this  was  not  operated  during  the  experimental  recording. 
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Procedure .    The  experimental  procedure  was  similar  to  that  for  Ex- 
periment I.    Immediately  after  a  5  minute  baseline  period  in  which  no 
reinforcement  was  administered,  there  was  a  25  minute  acquisition  per- 
iod, followed  by  a  10  minute  extinction  period.    Subjects  received  only 
the  initial  instructions  and  there  were  no  rest  periods. 

The  experiment  was  given  the  title  of  "a  study  of  involuntary  re- 
actions." The  subject  was  shown  into  the  experimental  room,  seated  in 
the  desk  chair,  and  given  the  following  instructions: 

This  is  an  experiment  in  learning.    We  are  attempting  to  con- 
dition an  involuntary  response  over  which  you  have  no  direct  con- 
trol.   I  will  attach  pickups  to  your  finger,  arm,  and  trunk  to  re- 
cord various  activity.    In  no  case  will  you  receive  an  electric 
shock  or  other  unpleasant  stimulus.    All  you  have  to  do  is  watch 
the  signal  light  that  indicates  when  you  are  making  the  correct 
response.    But  don't  try  to  make  any  kind  of  voluntary  response. 
Just  sit  in  a  comfortable  position,  relax,  breath  quietly  and 
evenly,  and  don't  make  any  unnecessary  movements.    This  will  take 
UO  minutes,  so  if  you  get  uncomfortable  and  have  to  move,  go  ahead 
and  change  position  but  don't  keep  moving  around  any  longer  than 
necessary.    It  is  necessary  for  you  to  stay  awake.    If  any  of  the 
equipment  slips  or  you  become  uncomfortable  you  can  call  me  over 
the  intercom,  which  is  on  all  the  time.    Do  you  have  any  questions? 

The  instructions  to  Group  B  (baseline  condition  throughout)  were 
the  same  except  for  omission  of  reference  to  the  signal  light  and  cor- 
rect response.    In  no  case  was  there  any  mention  of  the  initial  five- 
minute  baseline  period  or  the  final  10-minute  extinction  period. 

No  light  reinforcement  was  given  in  the  baseline  period.    In  the 
second  to  sixth  periods  (25  minutes  total)  which  followed  immediately 
after  the  baseline  period,  experimental  subjects  received  the  rein- 
forcement light  immediately  upon  the  termination  of  a  definite  vasocon- 
striction (no  amplitude  criterion  was  estimated  as  in  Experiment  I). 
No  attempt  was  made  to  selectively  reinforce  only  those  vasoconstric- 
tions that  were  not  associated  with  respiratory  or  EMG  changes.  All 
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constrictions  were  reinforced  unless  preceded  by  bodily  movement.  In 
the  seventh  and  eighth  periods  (10  minutes  total),  no  reinforcement  was 
given  subjects  assigned  to  Group  EN  while  those  in  Group  EC  continued 
to  receive  signals  at  about  the  same  rate  as  before  but  contingent  up- 
on five  seconds  of  minimal  vasomotor  fluctuation.    Each  subject  in 
either  of  the  control  (C)  groups  received  the  same  number  of  reinforce- 
ments per  five-minute  period  as  his  matched  experimental  subject  had 
received  during  the  25-minute  acquisition  condition,  but  contingent  up- 
on five  seconds  of  vasomotor  stability.    Reinforcement  was  omitted  for 
all  control  subjects  during  the  extinction  condition. 

Subjects  in  Group  B  were  treated  throughout  just  as  in  the  base- 
line period. 

Following  the  experiment,  the  subject  was  interviewed  for  his  re- 
port of  any  event  or  behavior  related  to  the  onset  of  the  signal  light 
and  for  any  specific  awareness  of  changes  in  the  finger. 

Scoring.    The  amplitude  of  all  measureable  decreases  in  finger 
volume  was  scored  so  as  to  exclude  the  respiratory  component  by  measur- 
ing the  vertical  distance  between  the  beginning  and  end  of  the  decrease 
at  corresponding  points  (phase)  in  the  respiratory  cycle.    The  cardiac 
component  was  excluded  from  vasomotor  scoring  by  measuring  along  the 
troughs  of  the  pulse  waves  of  the  plethysmogram.    Any  decreases  begin- 
ning during  the  interval  of  2  to  5  seconds  after  the  onset  of  the  light 
were  marked.    In  addition,  all  volume  changes  beginning  within  or  in 
progress  during  the  interval  of  2  to  5  seconds  after  onset  of  the  light 
were  scored,  including  increases  in  finger  voltime. 

Any  abrupt  fluctuation  of  the  plethysmogram,  due  to  the  slightest 


20 

movement  of  the  finger,  was  excluded  from  amplitude  scoring.    The  am- 
plitude was  scored  as  "?"  If  a  movement  completely  disrupted  the  vol- 
ume baseline  or  threw  the  pen  off  scale,  and  any  vasoconstrictions  2  to 
5  seconds  immediately  following  such  movement  artifact  were  noted. 

The  amplitude  criterion  of  vasoconstriction  was  individually  set 
for  each  subject  to  give  an  operant  level  for  the  baseline  period  of 
two  vasoconstrictions  free  of  preceding  or  concurrent  skeletal  muscle 
artifact  either  in  the  plethysmogram  or  EMG  channels.    This  criterion 
method  was  similar  to  that  of  Experiment  I  and  appeared  to  be  necessary 
in  order  to  equate  subjects  on  initial  operant  level,  regardless  of  re- 
cording sensitivity,  total  finger  volume  within  the  plethysmograph  cup, 
and  other  instrumental  variables  and  individual  differences  associated 
with  absolute  volume  measurements.    An  amplitude  cut-off  point  also 
eliminates  the  minute  volume  changes  that  may  not  be  vasomotor  (e.g., 
heart  rate  and  stroke  volume,  blood  pressure  changes,  etc.)  and  the  \m- 
reliability  in  scoring  these  small  fluctuations. 

The  amplitude  criteria  set  in  the  above  manner  provided  results 
comparable  to  Experiment  I  and  the  difference  between  means  for  the  ex- 
periments (I  =  1.66,  II  =  1.67  cu.  mm.)  and  between  conditions  for  Ex- 
periment II  (E  =  1.66,  C  =  1.68)  were  negligible. 

Due  to  ties  within  subjects,  it  was  not  always  possible  to  select 
a  criterion  that  would  give  a  baseline  operant  level  of  2.0.  However, 
the  differences  between  group  means  in  this  respect  were  negligible 
(E  =  2.00,  C  =  1.96,  B  =  1.83). 

With  the  original  intention  of  removing  by  means  of  analysis  of  co- 
variance  the  vasomotor  reflex  component  due  to  variable  respiratory  am- 
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plitude  (e.g.,  deep  inspiration:    Bolton  et  al.,  1936),  the  inspiratory 
amplitudes  preceding  and  concurrent  with  each  vasoconstriction  were 
scored  on  12  experimental  subjects.    However,  this  scoring  was  discon- 
tinued when  it  was  noted  that  intraindividual  correlations  between 
concurrent/preceding  inspiratory  amplitude  ratios,  or  between  concur- 
rent inspiratory  amplitudes  alone,  and  vasoconstriction  amplitudes  were 
very  low  and  many  respiratory  irregularities  occurred  that  were  not 
quantifiable  in  terms  of  a  single  measure.    In  view  of  these  difficul- 
ties, together  with  the  complication  of  adaptation  in  the  respiratory 
reflex  (Royer,  1966),  this  scoring  was  abandoned  and  any  vasoconstric- 
tion occurring  within  five  seconds  after  a  thoracic  or  abdominal  res- 
piratory irregularity  was  simply  tabulated  separately  and  excluded  from 
the  main  results . 

As  a  general  activation  level  index,  tonic  respiratory  rate  was 
sampled  over  a  one-minute  period  during  the  first  such  interval  in  each 
five-minute  period  that  was  free  of  gross  respiratory  irregularities. 
The  number  of  cycles  was  counted  to  the  nearest  half  cycle. 

The  integrated  EMG  records  were  first  carefully  inspected  in  re- 
lation to  concurrent  and  succeeding  vasomotor  activity.    Scoring  of 
phasic  EMG  activity  was  discarded  because  not  a  single  clear  case  of  a 
scoreable  vasomotor  reflex  to  skeletal  muscle  activity  was  discovered. 
That  is,  no  effect  upon  vasomotor  activity  was  noted  from  single,  brief 
spikes.    Either  short,  large  bursts  of  EM3  activity  threw  the  plethys- 
mograph  off  scale  or  there  was  moderate  but  continuous  EMG  phasic  ac- 
tivity which  was  related  to  moderate  irregularities  (usually  complete- 
ly unscoreable)  in  the  plethysmograph  record.    Thus,  the  hydroplethys- 
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mograph  was  more  sensitive  to  muscle  artifact  than  was  EMG  recording. 
Only  tonic  EMG  levels  were  scored.    A  10-second  average  level  was  meas- 
ured with  a  non-linear  scale  of  microvolts,  sampled  at  the  beginning  of 
each  minute. 

It  was  not  expected  that  heart  rate  (HR)  could  be  precisely  meas- 
ured beat  to  beat  since  the  recording  speed  was  only  2.5  mm. /sec.  and 
no  cardiotachometer  channel  was  employed.    However,  the  period  of  five 
HR  intervals  immediately  preceding  and  again  concurrent  with  non-res- 
piratory vasoconstrictions  were  sampled  in  the  experimental  records  in 
the  baseline  period  and  also  in  the  next  to  last  acquisition  period. 
In  all  subjects,  the  tendency  was  for  cardiac  deceleration  following  1 
to  k  seconds  the  beginning  of  a  non-respiratory  vasoconstriction. 
Therefore,  the  period  of  the  five  slowest  HR  intervals  in  finger  pulse 
volume  during  the  vasoconstriction  was  measured  to  the  nearest  0.1  sec. 
(0.25  nim»  on  the  record).    For  comparison,  the  period  of  the  immediate- 
ly preceding  five  HR  intervals  was  also  measured.  . 

Heart  rate  level  was  also  sampled  as  an  index  of  general  activa- 
tion level.    The  number  of  HR  intervals  was  counted  over  a  30  second 
interval,  taken  at  the  beginning  of  each  five  minute  period  for  all 
subjects.  .  ^  ,  . 

Results 

Vasoconstriction  conditioning.    The  mean  number  of  vasoconstric- 
tions of  criterion  amplitude  per  five-minute  period  for  the  experimen- 
tal, control,  and  baseline  groups  are  plotted  in  Fig.  2.    These  are  the 
primary  results  in  graphic  form,  with  the  exclusion  of  vasoconstrictions 
related  to  respiratory  irregularity  and  of  vasoconstrictions  following 
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two  to  five  seconds  the  onset  of  the  reinforcement  light,  which  were 
analyzed  separately.    The  mean  number  of  vasoconstrictions  for  Group  EC 
began  at  a  baseline  level  of  1.U2  and  reached  a  peak  of  6,25  after  2$ 
minutes  of  conditioning.    The  mean  for  Group  EN  began  at  a  baseline 
level  of  1.17  and  reached  a  peak  of  6,U2  after  20  minutes  of  condition- 
ing.   Subjects  under  the  control  condition,  on  the  other  hand,  began  at 
a  mean  baseline  level  of  1.12  and  decreased  to  0.21  after  20  minutes  of 
control  reinforcement.    The  mean  performance  of  the  baseline  group  was 
more  irregular  but  appeared  to  vary  randomly  about  a  mean  frequency  of 
0.83. 

The  control  data  included  so  many  zero  scores  following  the  initial 
baseline  period  that  analysis  of  variance  was  out  of  the  question. 
However,  of  the  1$  subjects  showing  any  change  at  all  from  baseline  to 
the  fourth  reinforcement  period,  lU  are  in  the  negative  direction. 
Discarding  zero  cases,  this  shift  was  significant  (p  =  ,002,  two- tailed 
Binomial  Sign  Test).    Also,  the  overall  difference  between  Groups  C  and 
B  during  conditioning  was  significant  (t  =  2.71,  28  df,  p<,02). 

The  differences  between  experimental  and  matched  control  conditionsf 
were  very  pronounced.    In  the  third  acquisition  period  (following  10 
minutes  of  conditioning),  23  of  2k  subjects  in  Groups  EG  and  EN  exceeded 
the  number  of  vasoconstrictions  of  their  matched  subjects  in  Group  C, 
and  this  included  all  2h  in  the  final  two  periods. 

However,  in  the  analysis  of  variance  described  below,  both  the  con- 
trol and  baseline  groups  were  excluded.    This  choice  was  made  rather 
than  using  E  -  G  difference  scores  so  that  the  analysis  of  the  experi- 
mental results  would  be  free  of  counter-conditioning  effects  in  the  con- 
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trol  condition. 

The  summary  of  a  2  x  2  x  5  factorial  analysis  of  variance,  with 
repeated  measures  on  one  factor  (Winer,  1962,  p.  337),  for  acquisition 
of  Groups  EC  and  EN  is  presented  in  Table  1.    The  trend  and  interaction 
variances  were  further  analyzed  into  linear,  quadratic,  cubic,  and 
quartic  components,  using  orthogonal  polynomial  coefficients  (Winer, 
1962,  p.  353).    The  linear  component  of  the  conditioning  trend  over  the 
five  reinforcement  periods  was  highly  significant  and  accounted  for  88 
per  cent  of  the  variance  across  periods.    The  quadratic  component  of 
the  trend  was  also  significant  and  accounted  for  12  per  cent  of  the 
trend  variance. 

The  factor  of  sex  was,  of  course,  a  portion  of  the  between  sub- 
jects variance  and  was  insignificant.    Individual  subjects  gave  peak 
frequencies  from  1  to  16  per  period,  corresponding  to  0.8  to  12.3  times 
the  mean  baseline  operant  level.    Males  gave  a  mean  peak  perfomance 
U.2  times  their  mean  baseline  level  after  20  minutes  of  training,  while 
females  gave  their  first  peak  after  1$  minutes  of  training  at  5»U  times 
their  mean  baseline  level.    The  fact  that  the  female  group  gave  two 
peaks,  one  in  the  third  and  another  of  nearly  equal  magnitude  in  the 
fifth  conditioning  period,  would  account  for  the  nearly  significant 
S  X  P  interaction  (.10>p>.05).    This  bimodality  of  the  female  group 
learning  curve  was  an  artifact  of  combining  early  and  late  conditioners 
since  it  was  not  observed  within  subjects. 

Vasoconstriction  extinction.    The  main  extinction  results  also  ap- 
pear in  Fig.  2.    As  can  be  noted,  under  the  EN  condition  with  complete 
omission  of  reinforcement,  mean  performance  remained  at  the  same  level 
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Table  1 


Summary  of  Analysis  of  Variance  of  Sex  (S),  Extinction  Condition  (C), 
and  Trend  over  Acquisition  Periods  (P)  in  Groups  EC  and  EN 
of  Experiment  EE. 


Source 

df 

Mean  Square 

F 

S 

1 

30.3000 

1.1?3 

C 

1 

0.0333 

0.001 

S  X  C 

1 

lO.oOOO 

O.3U3 

Error  (between) 

20 

3I.U833 

P 

u 

39.8000 

12.635  *** 

Plin 

1 

139.5375 

UU.290  **» 

Pquad 

1 

18.57UU 

5.897* 

Pcubic 

1 

1.0667 

0.339 

Pquart ' 

1 

O.021U 

0.007 

S  X  P 

u 

U.8000 

1.52U 

^  ^  ^lin 

J. 

U.'JOp 

^  ^  Pquad 

y  1 

2.1696 

0.689 

S  ^  Pcubic 

1 

8.8167 

2.799 

^  ^  ^quart 

1 

8.0095 

-  2.5U3 

C  X  P 

1 

u 

3.8667 

1.228 

C  X  Plin       :  \ 

1 

0.0375 

0.012 

^  ^  ^quad 

1 

3.2UII- 

1.029 

^  ^  Pcubic 

1 

12.1500 

•  3.857  ■, 

°  ^  ^quart 

O.038I 

0.012  . 

S  X  C  X  P 

u 

1.1333 

0.360 

S  X  C  X  Pii„ 

1 

O.70U2  ■ 

O.22U 

S  X  C  X  Pq^^^ 

1 

'/V   .  2.5030 

0.795 

S  X  C  X  Pcubic 

1 

,:  0.0667 

0.021 

S  X  C  X  Pquart 

1 

1.2595 

o.Uoo 

Error  (within) 

80 

3.1500 

**»  p  <  .001 

*  p  <  .05 
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as  at  the  end  of  acquisition;  but  under  the  EC  condition  with  rein- 
forcement of  no-response  during  the  extinction  phase,  mean  perfonnance 
began  to  drop  abruptly.    Omission  of  no-response  reinforcement  of  con- 
trol subjects  during  their  extinction  condition  produced  a  slight  in- 
crease in  mean  frequency  of  vasoconstrictions,  but  this  tendency  was 
not  statistically  significant. 

The  summary  of  a  2  x  2  x  3  factorial  analysis  of  variance,  with 
repeated  measures  on  one  of  the  factors  during  the  experimental  extinc- 
tion condition,  is  presented  in  Table  2.    The  trends  were  analyzed  over 
three  periods,  the  final  reinforcement  period  in  addition  to  the  two 
extinction  periods.    There  was  a  significant  linear  coir^ionent  account- 
ing for  96  per  cent  of  the  trend  variance.    Since  the  C  x  P  linear  in- 
teraction was  significant,  the  linear  trend  variance  was  further  ana- 
lyzed into  EC  and  EN  effects.    Only  the  EC  trend  effect  (PiingQ 
ble  2)  was  significant. 

There  was  no  need  to  test  the  significance  of  the  very  large  dif- 
ference between  Group  C  and  either  Group  EC  or  Group  EN  since  all  2h 
experimental  subjects  exceeded  the  performance  of  their  matched  controls 
during  extinction. 

There  was  a  tendency  (.10>p>.05)  for  linear  interaction  between 
sex  and  extinction  trend  which  favored  females.    In  the  female  EC  group, 
5  subjects  decreased  while  the  sixth  showed  no  change  with  shift  of  re- 
inforcement to  no-response. 

Vasomotor  response  to  reinforcement.    During  conditioning,  experi- 
mental subjects  made  a  total  of  51  vasoconstrictions  of  criterion  am- 
plitude beginning  2  to  5  seconds  following  the  onset  of  light.  These 


Table  2 


Svunmary  of  Analysis  of  Variance  of  Sex  (S),  Extinction  Condition  (C), 
and  Trend  over  Extinction  Periods  (P)  in  Groups  EC  and  EW 
of  Experiment  II. 


Source 

df 

Mean  Square 

F 

S 

1 

13.3U72 

0.51i8 

C 

1 

0.0139 

0.001 

S  X  C 

1 

13.3U72 

0.5U8 

Error  (between) 

20 

2U.3583 

P 

2 

6.7916 

'    .  2.555 

Plin 

1 

13.0208 

U.898  » 

p 

^  linTfp 

,  .  .1' 

2U.0000 

9.028  ** 

^lingN 

1 

0.0U17 

0.016 

P  ■ 
quad 

1 

0.5625 

0.212 

S  X  P 

2 

6.U306 

.  2.1il9 

S  X  Plin 

1 

9.1875 

3.U56 

^  ^  Pquad 

1 

3.6736 

1.38? 

C  X  P 

2 

5.5139 

2.07U 

.  CxP^.^ 

1 

■   '.  11.0208 

U.lli6  » 

°  *  Pquad 

1 

0.0069 

.  0.003 

S  X  C  X  P 

2 

1.0972 

0.UI3 

S  X  C  X  Pt  . 

Ixn 

1 

0.1875 

'  *,  1  0.071 

S  X  C  X  P  . 

quad 

1 

2.0069  , 

=  0.755 

Error  (within) 

Uo 

2.6583 

**  p<.oi  ^  '.  ' 

« P<.o5  .  '    !'l  ' 
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were  excluded  from  the  main  conditioning  results  because  they  were  re- 
spondents rather  than  operants.    However,  they  were  evenly  distributed 
across  periods  and  their  inclusion  would  merely  have  the  effect  of 
raising  the  entire  EC  and  EN  curves  of  Fig.  2. 

Fig.  3  shows  some  interesting  incidental  results  of  a  further  anal- 
ysis of  vasomotor  responses  to  light.    The  lower  curves  are  for  experi- 
mental and  control  amplitude  means  of  vasoconstriction  and  vasodilata- 
tion (algebraically  summed),  whichever  response  began  2  to  ^  seconds 
after  the  onset  of  light.    In  Curve  C  it  can  be  seen  that  there  was  on- 
ly an  initial  adaptation.    However,  in  Curve  E  there  was  initial  adap- 
tation followed  by  continuing  adaptation  to  the  point  of  a  mean  vaso- 
motor balance  toward  more  frequent  and  larger  vasodilatations  (values 
below  zero  on  the  ordinate)  over  constrictions  (values  above  zero  on 
the  ordinate)  to  the  light  in  the  fourth  conditioning  period.    The  bal- 
ance toward  constriction  to  the  light  again  occurred  during  extinction 
for  Group  EC  (the  only  group  receiving  light  signals  during  extinction) 
when  the  condition  of  reinforcement  was  shifted  from  response  to  no-re- 
sponse contingency. 

The  criterion  amplitude  means  for  Group  E  and  Group  C  are  shown  as 
horizontal  lines  in  the  upper  part  of  Fig.  3,  for  comparison  with  the 
mean  amplitudes  of  vasomotor  response  to  light.    The  latter  seldomly 
exceeded  one-fo\irth  of  criterion  vasoconstriction,  and  then  only  when  a 
change  in  conditions  was  introduced. 

Respiratory  control  and  conditioning.  Fig,  k  gives  the  results  of 
an  analysis  of  vasoconstrictions  associated  with  respiratory  irregular- 
ity which  were  excluded  from  the  main  vasomotor  conditioning  analysis. 
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The  curves  for  Groups  B  and  C  remained  essentially  level,  while  the 
curves  for  both  Group  EG  and  Group  EN  rose  during  the  first  half  of 
conditioning,  and  for  Group  EN  during  extinction. 

First,  it  can  be  noted  that  exclusion  of  these  data  from  the  main 
results  had  the  desired  consequence  of  eliminating  artifacts  that  would 
tend  to  inflate  the  main  effect. 

.  Second,  there  appears  to  have  been  a  conditioning  effect  in  the 
respiratory- involved  vasoconstrictions  themselves  (which  were  indis- 
criminately reinforced  during  conditioning).    The  cell  frequencies  for 
subject  by  period  were  too  low  for  a  statistical  test  of  experimental 
trend,  but  a  simple  comparison  between  experimental  subjects  and  their 
paired  control  subjects  indicated  a  very  significant  difference  during 
conditioning  overall  (p<.001  by  Binomial  Sign  Test).    The  mean  for 
Group  E  was  8,0  and  the  mean  for  Group  C  was  3*1  during  conditioning 
overall,  while  there  was  obviously  no  initial  difference  (baseline  per- 
iod in  Fig,  U).    Since  these  respiratory-involved  vasoconstrictions  also 
included  virtually  all  cases  of  respiratory  irregularity  that  occurred, 
this  result  indicates  that  significant  positive  conditioning  of  respir- 
atory irregularity  (by  coincidental  reinforcement)  took  place  in  the 
experimental  group.  ,' 

EMG  control.    As  mentioned  in  the  section  on  scoring  method,  no 
scoreable  case  of  reflexive  vasoconstriction  to  phasic  EhG  activity  was 
detected.    The  tonic  EMG  means  for  Groups  E  and  C  are  shown  in  Fig. 
In  Group  E,  EM}  level  began  at  a  mean  of  5»2U  and  terminated  at  a  mean 
of  2.80  microvolts  while  in  Group  C  mean,  level  fell  from  7»26  to  2,92, 
The  initial  difference  was  not  significant  (t  =  1,65,  U6  df,  p>.10). 
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The  analysis  was  not  carried  further,  since  the  trends  were  fairly  par- 
allel, the  control  level  fell  somewhat  more  than  the  experimental  level 
(which,  if  anything,  would  have  biased  the  main  results  in  the  conser- 
vative direction),  and  the  levels  in  both  groups  during  the  last  part 
of  conditioning  and  extinction  were  very  low  and  close  to  the  limits  of 
reliable  measurement. 

General  activation  level  control.    Respiration  rates  for  Groups  E 
and  C  are  shown  in  Fig,  6.    There  was  a  tendency  for  both  groups  to 
rise  but  only  13  subjects  in  Group  E  and  11  subjects  in  Group  0  showed 
a  rise  from  first  reinforcement  period  to  second  extinction  period, 
shifts  that  were  neither  significant  within  or  between  groups. 

Mean  heart  rate  levels  are  shown  in  Fig,  7.    No  consistent  differ- 
ences between  groups  were  found  for  this  index.    These  results  then 
suggest  that  levels  of  autonomic  activity  generally  remained  stable  in 
all  groups  and  the  vasomotor  conditioning  effect  was  fairly  specific. 

An  incidental  finding  of  significant  heart  rate  conditioning,  how- 
ever, is  shown  also  in  Fig,  7.    All  2h  experimental  subjects  showed  an 
increase  in  heart-rate  deceleration  during  criterion  vasoconstrictions 
from  baseline  to  fourth  conditioning  period.    In  the  baseline  period, 
the  mean  rate  for  the  five  beats  immediately  preceding  a  vasoconstric- 
tion was  80,0;  this  decreased  to  a  mean  of  75.0/min.  during  the  five 
slowest  beats  after  the  beginning  of  vasoconstriction.    In  the  fourth 
conditioning  period  (after  20  minutes  of  conditioning),  corresponding 
values  shifted  from  a  mean  of  78.8  to  a  mean  of  69.9.    Thus,  the  mean 
heart-rate  deceleration  increased  from  5«0  to  8,9/min. 

MAS  scores.    As  part  of  another  experiment,  the  subjects  were  ad- 
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minstered  the  Taylor  Manifest  Anxiety  Scale  in  class  groups  at  varying 
times  before  or  after  their  participation  in  the  present  experiment. 
Their  raw  scores  ranged  from  5  to  38  with  a  mean  of  1^.1  for  Group  E 
and  ranged  from  2  to  32  with  a  mean  of  I6.6  for  Group  C.  Correlation 
of  these  scores  with  total  number  of  conditioned  vasoconstrictions  dur- 
ing acquisition  for  Group  E  yielded  r  =  +.10,    This  value  was  so  low 
that  nothing  more  was  done  with  these  scores. 

Interview.    A  few  subjects  reported  a  relation  of  the  light  to 
preceding  emotion  appropriate  to  the  experimental  ("frightening"  or 
"alerting")  and  control  ("maternal")  conditions.    Six  of  the  experimen- 
tal subjects  reported  changes  of  pressure,  tingling,  or  warmth  while 
control  subjects  reported  only  numbness  or  throbbing  in  the  finger. 
No  other  relation  of  interview  reports  to  vasoconstriction  conditioning 
was  observed.  . ,  ^ 

Discussion 

The  vasoconstriction  conditioning  of  experimental  subjects  would 
appear  to  be  independent  of  skeletal  muscle  involvement  including  move- 
ment, muscle  tension,  respiration j  and  of  changes  in  general  activation 
level.    There  was  a  highly  significant  upward  trend  in  the  frequency  of 
vasoconstrictions  during  experimental  conditioning. 

During  experimental  extinction  there  was  a  significant  downward 
linear  trend  for  the  EC  group  (F  =  9,03,  p<,01),  which  received  control 
reinforcement,  but  not  for  the  EN  group,  which  received  no  reinforcement 
during  extinction. 

On  the  other  hand,  the  baseline  control  group,  which  received  no 
reinforcement  throughout  the  entire  UO  minutes,  remained  essentially  at 
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initial  operant  level  throughout. 

The  matched  control  group  showed  some  counter-conditioning  effect 
from  reinforcement  of  vasomotor  stability  (no-response  contingency). 
There  was  also  a  tendency  for  Group  C  to  increase  in  number  of  vasocon- 
strictions when  reinforcement  was  omitted. 

These  control  results,  together  with  the  "alerting"  vasomotor  re- 
sponses given  by  Group  EC  to  the  extinction  reinforcement  (see  Fig.  3) 
help  to  clarify  the  differences  between  Groups  EC  and  EN  during  vaso- 
constriction extinction.    Although  this  result  was  anticipated  before 
the  experiment  was  begun,  the  rationale  upon  which  it  was  based  was 
vague.    The  EC  extinction  condition  was  included  because  it  was  possible 
that  complete  omission  of  reinforcement  for  10  minutes  (Group  EN)  might^ 
disrupt  performance  and  increase  vasomotor  activity.    The  results  of 
Group  C  during  acquisition  and  extinction  along  with  those  of  Group  EC 
during  extinction  all  support  the  conclusion  that  control  reinforcement 
had  a  counter-conditioning  effect.    However,  this  helps  in  no  way  to 
account  for  the  lack  of  extinction  in  Group  EN. 

The  simplest  interpretation  would  be  that  the  extinction  condition 
was  too  brief  to  produce  a  decrement  in  vasoconstriction  frequency  of 
Group  EN.    This  is  a  possibility  and  it  is  unfortunate  that  a  longer 
extinction  phase  could  not  be  included  in  the  50  minutes  that  each  sub- 
ject was  available. 

Another  possibility  is  that  there  were  no  extinction  effects  in 
either  experimental  group  and  that  the  apparent  counter-conditioning  in 
Group  EC  was  due  to  the  chance  assignment  of  slow  conditioners  to  this 
group  so  that  their  mean  performance  happened  to  peak  just  at  the  end  of 
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the  conditioning  phase.    The  drop  during  extinction  would  then  have  to 
be  due  to  interference  effects  which  occurred  in  both  groups  but  at  dif- 
ferent times.    A  2  X  2  X  7  factorial  analysis  of  variance  of  sex,  ex- 
tinction, and  trend  over  all  reinforcement  and  extinction  periods  (Ta- 
ble 3)  indeed  gave  no  significant  differences  or  interactions  involving 
EC  vs.  EN  groups.    The  overall,  linear,  and  quadratic  trend  components 
were  the  only  significant  results.    But  a  significant  quadratic  trend 
is  what  one  would  expect  from  a  limited  period  of  conditioning  followed 
by  a  brief  extinction  period.    In  this  analysis,  F  =  28.58,  1/120  df, 
p<.001  for  Pqua,d*  quadratic  trend  during  conditioning  only 

(Table  1),  F  =  5.90,  l/80  df,  p<.05.    These  results,  along  with  the 
significant  extinction  trend  for  Group  EC  only  (Table  2),  support  the 
conclusion  that  counter-conditioning  of  Group  EC  produced  a  highly  sig- 
nificant decrement  in  frequency  of  conditioned  vasoconstrictions.  To 
argue  further  that  this  decrement  might  have  occurred  without  counter- 
conditioning  seems  to  oppose  additional  evidence.    The  most  relevant 
result  is  the  fact  that  Group  EN,  without  counter-conditioning,  did  not 
show  a  significant  decrement  either  before  or  after  extinction  was  be- 
gun.   However,  it  would  be  desirable  in  further  research  to  study  both 
conditioning  and  extinction  over  longer  periods  in  order  to  check  var- 
ious extinction  effects  following  a  stable  asymptote  of  conditioning. 

The  second  experiment  replicates  the  main  results  of  the  first  ex- 
periment very  closely.    In  Experiment  II  the  vasoconstriction  condition- 
ing was  just  as  pronounced,  and  the  extinction  results  support  the  con- 
clusion that  the  conditioning  effect  in  both  experiments  was  not  due  to 
any  bias  in  exclusion  of  artifacts  in  analyzing  experimental  and  control 
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Table  3 


Summary  of  Analysis  of  Variance  of  Sex  (S),  Extinction  Condition  (C), 
and  Trend  over  Acquisition  and  Extinction  Periods  (P)  in  Groups 
EC  and  EN  of  Experiment  II. 


Source 

df 

Mean  Square 

F 

S 

1 

38.0952 

0.91U 

C 

1 

0.5952 

O.Olli 

S  X  C 

1 

20.0239 

0.U80 

Error  (between) 

20 

U1.702U 

P 

6 

26.8333 

7.601  ** 

Plin 

1 

55.U301 

15.702  «** 

VJ  LiCtU, 

1 

100.893U 

28.580  «*» 

^ cubic 

1 

0.69UU 

0.197 

1 

3.8961 

i.ioU 

Rssidueil 

2 

0. Oil  30 

0.012 

S   T  P 

\j 

1 

^  ^  ^lin 

1  '  ■ 

o.pio 

S  X  Pquad 

1 

8.0005 

2.266 

^  ^  Pcubic 

0.0000 

0.000 

S  X  Pquart 

V  ,  ..:  10.6071 

3.005 

KesiQuai 

2 

5.57OU 

'  1.570 

C  X  P 

6 

3.u8Ul 

0.987 

C  X  Piin 

1 

1.8229 

O.5I0 

C  ^  Pquad 

1 

0.6076 

0.172 

^  ^  ^cubic 

1 

2.2500 

0.637 

C  X  Pquart 

1 

7.636U 

2.163 

Residual 

2 

.;  U.29I1O 

1.216 

S  X  C  X  P 

6 

.    i  I.2U6O 

0.353 

S  X  C  X  Piin 

1 

0.0015 

0.000 

S  X  C  X  Pq^ad 

1 

1.1910 

0.337 

S  X  C  X  Pcubic 

1 

U.oooo 

1.133 

S  X  C  X  Pquart 

1 

O.U773  : 

0.135 

Residual 

2  . 

0.9031 

0.256 

Error  (within) 

120 

3.5302 

***  p  <  .001 
**  p<.01. 
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data.    Therefore,  it  can  be  concluded  that  the  operant  procedure  re- 
sulted in  the  conditioning  of  the  autonomic  activity  of  vasoconstriction 
in  the  finger,  not  mediated  by  means  of  skeletal  muscle  activity. 
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Two  experiments  were  performed  to  study  simple  operant  condition- 
ing of  peripheral  vasoconstrictions  in  humans.    In  the  first,  experi- 
mental subjects  were  reinforced  with  a  small  "correct"  signal  light  for 
each  criterion  vasoconstriction  in  the  right  index  finger  tip,  while 
their  matched  control  subjects  received  the  same  number  of  reinforce- 
ments but  only  following  minimal  vasomotor  fluctuation.  Reinforcement 
was  given  in  the  context  of  a  pseudo-task  of  discriminating  and  report- 
ing very  small  and  slow  temperature  changes  in  the  finger  cup  of  the 
hydroplethysmograph .    Excluding  vasoconstrictions  following  verbal  re- 
ports, the  frequency  of  large  vasoconstrictions  increased  very  signi- 
ficantly over  30  minutes  of  conditioning  of  experimental  subjects  where- 
as that  of  the  control  group  remained  essentially  at  baseline  operant 
level.    The  effect  was  well  beyond  what  might  have  been  due  to  somatic 
mediation  via  gross  skeletal  muscle  activity  so  far  as  could  be  deter- 
mined from  movement  artifacts  and  respiratory  components  in  the  plethys- 
mograph  records.  '   ;  -i"' 

In  the  second  experiment,  a  similar  method  was  used  except  that  the 
pseudo-task  and  verbal  reports  were  eliminated,  and  respiration  and 
forearm  muscle  tension  (EMG)  were  separately  recorded.    A  10-minute  ex- 
tinction condition  was  added,  with  experimental  subjects  split  into  two 
extinction  conditions:  shift  of  reinforcement  to  vasomotor  stability 
(EC)  and  omission  of  all  reinforcement  (EN).    Omitting  a  few  UCRs  to  the 
reinforcer  light,  the  mean  frequency  of  non-respiratory  vasoconstrictions 
increased  very  significantly  in  the  experimental  groups  during  condition- 
ing.   The  performance  of  the  control  group,  under  counter-conditioning, 
decreased  below  that  of  a  baseline  control  group  which  remained  at  ini- 


tial  operant  level  throughout  UO  minutes  with  no  reinforcement  whatso- 
ever.   During  the  extinction  phase  of  10  minutes,  vasoconstriction  fre- 
quency of  Group  EC  decreased  significantly  hut  not  that  of  Group  EN. 
These  conditioning  and  counter-conditioning  effects  were  independent  of 
changes  in  respiration,  muscle  tension,  skeletal  movements,  and  general 
autonomic  activity  levels. 


